Spatio-Contextual Deep Network-Based Multimodal Pedestrian Detection for Autonomous Driving

نویسندگان

چکیده

Pedestrian Detection is the most critical module of an Autonomous Driving system. Although a camera commonly used for this purpose, its quality degrades severely in low-light night time driving scenarios. On other hand, thermal image remains unaffected similar conditions. This paper proposes end-to-end multimodal fusion model pedestrian detection using RGB and images. Its novel spatio-contextual deep network architecture capable exploiting input efficiently. It consists two distinct deformable ResNeXt-50 encoders feature extraction from modalities. Fusion these encoded features takes place inside embedding (MuFEm) consisting several groups pair Graph Attention Network unit. The output last unit MuFEm subsequently passed to CRFs their spatial refinement. Further enhancement achieved by applying channel-wise attention contextual information with help four RNNs traversing different directions. Finally, maps are single-stage decoder generate bounding box each score map. We have performed extensive experiments proposed framework on three publicly available benchmark datasets, namely KAIST, CVC-14, UTokyo. results them improved respective state-of-the-art performance. A short video giving overview work along qualitative can be seen at https://youtu.be/FDJdSifuuCs . Our source code will released upon publication paper.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

GPU-based Pedestrian Detection for Autonomous Driving

We propose a real-time pedestrian detection system for the embedded Nvidia Tegra X1 GPUCPU hybrid platform. The pipeline is composed by the following state-of-the-art algorithms: Histogram of Local Binary Patterns (LBP) and Histograms of Oriented Gradients (HOG) features extracted from the input image; Pyramidal Sliding Window technique for candidate generation; and Support Vector Machine (SVM)...

متن کامل

Vision-Based Pedestrian Detection for Driving Assistance

This survey focuses on some of the most important and recent algorithms for pedestrian detection in video sequences taken from a camera mounted on a car. The longterm goal of this line of research is to develop vision-based systems that could be successfully implemented in cars for driver support in urban scenes or for autonomous driving. Some of the surveyed systems have already proved their e...

متن کامل

Pedestrian Detection with Deep Convolutional Neural Network

The problem of pedestrian detection in image and video frames has been extensively investigated in the past decade. However, the low performance in complex scenes shows that it remains an open problem. In this paper, we propose to cascade simple Aggregated Channel Features (ACF) and rich Deep Convolutional Neural Network (DCNN) features for efficient and effective pedestrian detection in comple...

متن کامل

In Teacher We Trust: Deep Network Compression for Pedestrian Detection

Deep convolutional neural networks continue to advance the state-of-the-art in many domains as they grow bigger and more complex. It has been observed that many of the parameters of a large network are redundant, allowing for the possibility of learning a smaller network that mimics the outputs of the large network through a process called Knowledge Distillation. We show, however, that standard...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Intelligent Transportation Systems

سال: 2022

ISSN: ['1558-0016', '1524-9050']

DOI: https://doi.org/10.1109/tits.2022.3146575